Search for: All records

Abstract Large multimodal language models (MLLMs) such as GPT-4V and GPT-4o have achieved remarkable advancements in understanding and generating multimodal content, showcasing superior quality and capabilities across diverse tasks. However, their deployment faces significant challenges, including slow inference, high computational cost, and impracticality for on-device applications. In contrast, the emergence of small MLLMs, exemplified by the LLava-series models and Phi-3-Vision, offers promising alternatives with faster inference, reduced deployment costs, and the ability to handle domain-specific scenarios. Despite their growing presence, the capability boundaries between large and small MLLMs remain underexplored. In this work, we conduct a systematic and comprehensive evaluation to benchmark both small and large MLLMs, spanning general capabilities such as object recognition, temporal reasoning, and multimodal comprehension, as well as real-world applications in domains like industry and automotive. Our evaluation reveals that small MLLMs can achieve comparable performance to large models in specific scenarios but lag significantly in complex tasks requiring deeper reasoning or nuanced understanding. Furthermore, we identify common failure cases in both small and large MLLMs, highlighting domains where even state-of-the-art models struggle. We hope our findings will guide the research community in pushing the quality boundaries of MLLMs, advancing their usability and effectiveness across diverse applications. 

A<sc>bstract</sc> We study the azimuthal angular decorrelations of dijet production in both proton-proton (pp) and proton-nucleus (pA) collisions. By utilizing soft-collinear effective theory, we establish the factorization and resummation formalism at the next-to-leading logarithmic accuracy for the azimuthal angular decorrelations in the back-to-back limit in pp collisions. We propose an approach where the nuclear modifications to dijet production in pA collisions are accounted for in the nuclear modified transverse momentum dependent parton distribution functions (nTMDPDFs), which contain both collinear and transverse dynamics. This approach naturally generalizes the well-established formalism related to the nuclear modified collinear parton distribution functions (nPDFs). We demonstrate strong consistency between our methodology and the CMS measurements in both pp and pA collisions, and make predictions for dijet production in the forward rapidity region in pA collisions at LHC kinematics and for mid-rapidity kinematics at sPHENIX. Throughout this paper, we focus on the application of this formalism to a simultaneous fit to both collinear and transverse momentum dependent contributions to the transverse momentum dependent distributions.